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mm ' 



^3L^m^^ ( ^m^^ : APP^TUS AND METHOD FOR TIME STAMPING USING x 
MODULO TIME BASE AND TIME INCREMENT RESOLUTION ' 

A time stamping apparatus uses modulo time base and time increment 
resolution for efficiently encoding a local time base for different video/audio 
sources embedded in the compressed data. The local time base is mainly 
encoded in two parts: a modulo time base that indicates the specific interval in the 
reference time base; and a time base increment relative to the reference time. 
Two forms of time base increment are used to allow for the possibility of different 
encoding order and displaying order. A'resolution for time base increment is 
introduced here to allow video/audio sources of different frame rates to be 
encoded and multiplexed into one bitstream. Also, bit saving is also obtained for 
some of the video frame rates. The parameter of time base increment resolution 
can be placed in the header of group of video object plane. 
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' MPEG-l m MPEG-2 ^ ti fiU ^ M 4" • 

MPEG-l m MPEG-2^^^1f}^4' ' SJn^r^fK^^S 33 

■ ffi MPEG-4 VM7.1 4^ » modu 1 o_ t i m e _b a s e 
ea VOP_tirae_increment Al-X-ffiM^^glJ^I® ° lit ^ 
- 1@ modulo_time_base S^-ffi^^Sip - SS^SSmi^ 
F^StP*2:!|#^^IS • a^H-fi VOP_time_increinent 
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i ^ ^mum ( 2 ) 

turn 1 m 2 HH^^ ' modulo_time_base i^X-^M 

vop mm^mmmzmm • mmm "i-^mm-m 'Q-zm 

^m^-^mmm^Z 1/?-Y0? Z modulo.time.base)^^ 

mmmitfumummm^m • nm-mms^}- • -mM^ gov 

-m i-vop m (mm^^mmmn)z b-vop - 

m GOV ^ m ^ ^ n - {i i/p-vop M m • 

modu 1 o_t i me_base ^ ^ iE GOV M ^ ^ §i 
tiine_code;5l^^'' 

m)Z B-VOP Ma ' modu 1 o_t i me_ba s e ^ ^ :S GOV 
m^^mt^ time_code Zmf^ ' 

n hl 7t ^ n ^ B-VOP 1^ . m m ^ m m w i: 

time.base • -mmm^M^Z I/P-VOP m GOV ^ffi* 

^rfDS-f@S^^«?5S;2: i/p-vop^^ • 

seSDH 1 M 2 iaM^# ' VOP_time_increinent Iji 

*^zw{iLM.mm^mmmm ' m i/?-yop m B-vo? m 

H • Jtbfi:&S modulo_time_base ^ ^ 2: # ^ fb Si ® 

5: $g ^ VOP_t i ine_ i ncrement ° . 

ffim 1 mn^^ i:xm^^.mnwzm-m vop(B-vop)isj^ 
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i ^ ^^m^n ( 3 ) 

I-VOP Zm ' iSi^ time.base m ]^ ^ GOV 1i Sl 4" ^ 
time_code»mH^V0P(B-V0P)^5^iJ<m-V0P(I-V0P) 
mi^^Z modulo_time_base ffi 1 ^Sf^MZmm^ ' iK 
mHV0P(B-V0P)2:raodulo_ti!ne_baseie:^Mfe "10"° 

mra vop(B-vop)jg iR^m- vopci-vop) - mm vopcb- 

VOP) Z modulo_time_base 'B M 1^ " 10" • ^ E 
VOP(P-VOP)|i [q] m- VOP(I-VOP) ' VOP(P-VOP) 
Z modulo_time_base "110"? 

2 . i:ixmw:mmwzm=. yo?(ii-vo?)^n 

GOV time_code m 1 !3> S H ^ 19 1^ ' 

V0P(I-V0P)2.modulo_tiine_basejej.^^ "10"' fi^f^ 
HE VOP(B-VOP)f| iSimn VOP(I-VOP) • mH YOP(B- 

VOP);t modulo_tinie_base "0" = 

®?s«i^s:fe^ffl{i?Fi3Sig^5:@- vop BiEmmmmM 
m ' ^ -m-^m^anmm Km t^i}pmm mm )n mm - 

^^mm VOP • 

1 ^ 2 • yOP_time_increment M 

mm^zmmm • ^mmmwm^nmm^m^nmm 

m ' mtca 23.976Hz > 24Hz • 29.97Hz • 30Hz • 50Hz • 

59.97HZ' 60Hz^-E 2b^z zumm w ' =.mm zwm 
mm% 40ms(ioooras/25)' s."^ m M z M m m m B ^ 
mmmmmmitmm - fammm 29.97Hz mm • -mrs 
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i > ^m^m ( 4 ) 

5;^FBliEli:^ 33.3667ms(1000ins/29.97)"1SSffi^^ 
^m2.mmmWiBmm - VOP.time.increment MSM^ 
IttifS ' m VOP_time_increment M ^ U W • ^ 

VOP_tiine_increment mt^M m U - M ^ m ' 

m ' 

m m ± m m ^ m - ^jsi^e^^^pg®^® 

VOP.time.increment «l «f S & g fi^ Ife * J5t Si M 

#^inia^fi«ifg^ • jtfcRr3ifi5iA-afiif^& 

VOP_time_increraent_resolution i^frS^^^Tn^flD 

• itrnwcsstam 1 2 ^M^jfeSJMif* GOV 

|a )VOL ' 

m 1 ^ 



group_of_VideoOb jectPlaneO { 






group_star t_code 


32 


bslbf 


VOP_t i nie_i ncreinent_resolut ion 


1 5 


u i m s b f 


time_code 


1 8 


bslbf 


Closed_gov 


1 


u i msb f 


Br oden_ 1 ink 


1 


u i m sb f 


next_start_code ( ) 






} 
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V i deoOb jectLayer(){ 




^ ^ i?F afe 
wj i\r 2/t 


video_object_layer_start_code 


32 


bslbf 


video_ob ject_layer_shape 




u i msb f 


VOP_t i ine_ i ncrement_resol ut i on 


15 


uimsbf 


i f (vide o_object_ lay er_shape! = 
"binary only"){ 






i f (video_ob ject_layer_shape = = 

"r ect angu 1 ar " ) { 




uimsbf 


video_ob ject_layer_width 


13 


uimsbf 


video_ob ject_layer_height 


13 


uimsbf 


} 






Sprite_enable 


1 


uimsbf 


( 

) 






} 







SM^ft 701^4" VOP_time_increment_resolution ;i ^ 



^ H 1 ^ If ' group_start_code 32 iu.7ZZ«^ 

-mm • ^^m- gov i^mzmm - nf^ • vop.time. 

increment.resolution M — M 15 iu. ji Z 't^ W ^ tfl M 
5t5 ^ ^ YOP_time_increment Z M I^T M ' # fi 5fe isS ^ ± 
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i ^ ^m-^m ( 6 ) 



m^m^^m vop ^p^*i««^-®^ig^i5[^SF^;^ 

^^M^M^^XZ VOP_t ime_ increment _resolut ion 
^ inodulo_time_base R VOP_time_inc.rement — ffi rT ifc 
ffi 1"! IS $ ffic g| . VOP_t i me_ i ncremen t_reso 1 u t i on 
l^^-mWLmmJtmmmWcR VOP.time.lncrement m 
ft^^-ji modulo_tiine_base ^ Z Wt ^ — M 0 m 

VOP zmmm-^immmm^ummm^zmmm - 

t:X !iiodulo_tiine_base m^^^MSfi^I^^mS* 
VOP_time_increment M VOP_t ime_i ncrement.reso 1 ut i on 

zitmffn^^mmm^mi^itmmms^w ' m 
VOP zmmm 

= time_code + modulo_time_base 

+VOP_t i me_i ncreinent/VOP_t i me_i ncrement_reso 1 ut i on 

m^mi^mm^^z^hmii&&mmm - 

VOP_time_increinent_resolution W-M^ GOV Ji 

m ^m)Yoi m ^ pxm m m m. z m m m/f n m M z 
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• ^mum ( ^ ) 

mmmmmmm^ m - vop_t ime.increment m 

m 3 mi^-mmm^Mm^m^wtmmnM.m 
m 4 Hfe-i^F^ii ' m^^^^^:^mmmi^mm 25 hz 
m 5iii^-^r<aiB > mn^m^mmmi^m^i'^m - 

1 m 2 mm^-2.^9!mm • modulo_time_base 
m VOP_time_increment mWffilsIfi^Ea • B ^ tfJ M ^ 
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jL > ^m^m ( 8 ) 

VOP_t ime_increment S W rT @ fi^ ^ Iff ' ^W. 
JM^Ift GOP M^7^ VOP_tiine_increment_resolution • 

ISH^-'SJtt'tf ' VOP_t ime_increinent_resolut ion( tg 

m-^mzmm'^ 29. ^lYiz'-mmmm^mm 29. 97 etg . 

2 9 9 7 mnmmm(.^m%mm.)i^nmm^. ' %%^%m^ 
*jit^M;^K@'-flfflWM3g on 2%^i ^iLmum 12 

iu.7t2, VOP_time_increinent_re solution • 

Ifcfc 12f5 7c;^ V0P_tiiiie_increment_resolution^KM5^ 

GOV m ' n m m ^ m 1 ^ 5: ig = 5>j 

(VOP_tiiiie_increment) "f^ffi^ 2 ^i^mH??!! 
(VOP_tiine_increment)iti ' - mm^^ W^Z^Wl • 
IP 15 ffiTC;^ VOP_time_increment_resolution § 

^ - Hjtfc 29 mzm mmn 2900 . 3 hir^ 
2:^HP*iflg||30<i*gffim-<@^®:itrafi<f97<iitfiS 
m 29 tgiii^^astf-® • in±T-<@^i5[^^;t^^h 3 m 
mmmmM - 

ffi JH: If B 4" • VOP_time_increinent_resolution 
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s. > ^^n^^n ( 9 ) 

VOP_time_increnient = '^TWBMMitmM^MZ — 

mmm ' ^mmm mmm^' mm^^Mm^. - 
@^*jitNFM2:iS[S ' miikM.m'f\-n o m 25 mitmrn 

'^^ — M 5 iiiTt^Z VOP_ t i me_ i nc r em e n t _r e s o 1 u t i 0 n 
Uf^Wifl ' it— 5 i{L7t2. VOP_time_increinent_resolution 

i^xm^mmm^ :^ ^ m m n gov ®ii(^)vol 1 

• HJlt ' YOP_tinie_increiient m W 5 {Stc^ 
VOP_time_increment_resolution ^ ^ 

- m m m m - n % 40ms - m 5 s tc 5: 

VOP_time_increment_resolution itl&W^^^ffi 
ffi fi^ 10 IS TC VOP_t i me_ i ncrement_r eso 1 ut i on 
^ — ^^^ VOP_tiine_increinent_resolution • 

Modulo_time_baseM VOP_time_increment iOH 

3^m^tfeiiaB*voPM4^- 
m 3 s 





7C » 


VideoObjectPlane(){ 




V 0 P _ s t a r t _ c 0 d e 


sc + 8 = 32 


do { 




Modulo_tine_base 


1 


}while(Modulo_time_base!= "0") 




VOP_time_increment 


1-15 


-12- 
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i . ^m^m ( 10) 

H 3 Modulo_time_base VOP_time_increment 

^ ^ m . VOP_time_increment ^ ^ & W. 

Moduio_time_base m^i^mmit^zmm 

VO?_time_incTement ' Um^mmm i^i- n 0 m 

VOP_time_increment_resolution^)R;^{i«f^^jlt 

m z ii Ttmm m ^ m ^ ± m m m m m m m 4^ m E z m 
% ' iiJ.^'%miiLzm^mmmmmmn6tiK^i^x 

VOP_t i me_ i ncremen t_r eso 1 ut i on M S # • 

mmm^^ ' m^tsim^^mm 5 mmmmmzmm ' mm'^z 
mmmm yo? t^m^^mn u - m > ^2 ^ ' ?3 mmm • 

mi>x GOP immzmm.)ummmAn ^o? muzmU'^ 

, mmiEmt^m^mf] 1 23 ^ 45 B 350 

( 1:2 3:4 5:3 5 0 ) m M : H - (Bl-VOP) ffi « 
1 : 2 3 : 4 5:7 5 0 IS IS ^ ; H H S (B2-V0P) ffi «E 
1:2 3:4 6:1 5 0 M H ^ ! Ife Itfc Jt • 

zum^^^m^^nn^m ' :^mmzmm^m4^ttmn 
^mRmitmmmxm-m(yopyznm'Mm • 
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B7 ■ 

^^^mm ( 

mmn^m^m vop ^^iMMn-s^n-^ji^s- 

lim^^H - vop(ii-vop)j-)tit ' ^ « fS>5:ll^«3i^M 

$am5iim-?>JlB^#'V0P<gffl-^igSl(*M 

tii)^-^^^F^?S^^"a VOP S^^ffi^i^M^ 

m ' VOP ^^?!ji5isciisii6j3SiasB>jm.3jc^ ' mmmi^ 

VOPCBP B-VOP)^1S5efiLi6^ B-VOPmJi^^ P-VOP^ 

m ' Silt ' VOP M II ' PI ' Bi ' B2'P2' B3 it ^ n 

mmm 5 mzm^nm^^^ • ^ei^f^ ti - bp gop^ 
mmp^mmmm ' m^i^mmmmw^m^ GO? mmp^m 

mmmmm^^^'^ l:23:45-^^ffi^KT2H5'G0P 

mm ^ ^ ^ ^mm ' 

mm^mm t2' m-m \o?u\-\o?)mik^ • 1^ 

^ ^ ^ ^)mmwm^nmm-m vop(ii-vop)^a 
zmmcm ^ - ^) ' ^mttm • itmi^mu^mm - 
mtt'm&wt^m± - o-- ^ ^ k m - f@ vopc 1 1 -vop) 

mm i&m m ^ " Q-mrn m^mm mm mm^zm 
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I > ^mum ( ^2 ) 

vop(ii-vop)4ii^ ' ^ ^ ^ mmmmm • m it • 

^ m m t3hu ' m m - m v o? c ii - y o? ) m z iu. it 

5* vop ^^JiME ffi mmm ' 

^fiS^F^ T3 ' B-M V0P(P1-V0P)?^|&^ . ^ 

mm it mm itwtmwn m^mmmmm^^^^ zmm 

voP(Pi-V0P)it3;^i^^jtg[ff j^ggui^p^ 

mmm^mzmmi^-'^ ' ^it ' itmmm^ - lo-* 

^m-a VOPCPl-VOP)^^^!?!!*^^!!^^^*?®^^ 

:^f3'GlFT-^^^ • mmr.m vop(Pi-vop):ffi ^^^j^ 

m^n^mmm^mz^m-fy-^m^'mitmmm 

^^"110"- 

T3 ' B-VOPf^P^S!*W#^^^^^^ 

^ffi^r^ T3 mw.mmmm^mwimwm^mnzm 
m-^mm^ '^-YQ? mmmmm^mwLWL'^% 1:23: 

mmmmm^mmr.m vop(pi-vop)cf' f^ • Hjtt • 

ffii«:«ilJ4''^^g|5^^S*W#Sffitii»:^i:23:46. 

^m\tm.mmm.^z " \^''mmmi^mwimm^z^ 

- VOP(Pl-VOP) o iHllt . S^M^.J^m- VOP(Pl-VOP)^ 
^^:9-«!^MMI§?-@ltb'«l^^T4H(f'll-V0P(Pl-V0P) 
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^ ' ^) ' i^mstm • nitmmmi^mmm • @jit • itm 
mm± "o"^f^^H vop(Bi-vop)ft M B-vop ^r^sii 

mmmnmnmmm^zm- vopcbi-vop) • isi^ ' w 

mm^nm- vopdi-vop);^:^ ^ ^ ^'^^mmm - ma - 

^mfM T5 HU • V0P(Bl-V0P)mffl2:fii7CgE^*4J'>^ 
" O-'SKS AS^^icltSlIII " 7 5 0 "M«Aijf^ VOP ^ fi 
M ^ rfn ^ ^ '# • 

^f^SltP^ T5 . mm VOP(B2-VOP)1i5J&15Z • ^ ^ Si 

itiestbijji^j* B-VOP ^p^a!i®#s*2it^(it^ 

' f>)^W^i[#lf^m0 V0P(B2-V0P)tti;J:^^(lt ^ 

vop(B2-vop);^i^^ jt^^j^ B-VOP nf^mwm^mz 

^r^^-# " sjtfc ' m m m ^ "io-^^^eh 
vop(B2-vop)s«#j^ B-VOP nnmwmumz^^mi^ 

^^mm B M VOP zn • ^spitF^s^ia b-vop m 
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K 

m m vop(B2-vop)-(sjit' vop(b2-vop) 

;^l^^fl-^!J>M?BI§?-@Jtfc'ft^^T6Hff'mEVOP(B2-V0P) 
f^.Vk^n^ T6 . VOP(P2-VOP)^J&fl5l • 1^ B| 

^)^mmm^nw.^ vop(P2-yop);^^^ ^ ^ « 

!^)- ffiSjtfc^iJ ' ^ltKi^»&SI^^1?J^m£ V0P(P2- 

^ ' mat ' mitmmm^ Mo-'^^^ms vop(P2-vop):s 

^mm m ' b-vop mmmmm^^mmmmmn 

^etm^ ' B-Yo? wmmmm^^^mmm 1:23:46. 

mm • ^^m t6 • ^gp^r«is!pMii»M#s^^#i5^ 
ma vop(P2-vop);^^^ • ajtb^^^im^ • mmmmwi 
mmm^smmmm 1:23:47. 

m5V0P(P2-V0P).l5llt'W^^#M-^5:V0P(P2-V0P) 
;i^':9-'^fi![MI^.Hl«:'S^^T4HU'maV0P(P2-V0P) 
m ffl 2: fS 7C « r4 i-X " 1 0 Ji A ^ St It S li & " 3 5 0 "S? 
m A Jr^ VOP ^ FbI ii 1: ^ M ^55 ® # 

6tm ' mmmi'^mmmmm yo? MBfpimTtmmnm 
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• mmn GO? mmzmm\m ^ ^ ^:)mm^ ' mm 
ssfa I mm PM vopcfip^ BM yop)z^ ' mwn 

n 0 mz 1 fi5{iS[^^'i5i^-#iiw^*4]fe "10"^ 
-110"!^ ' ^u-mm-^z B-vop mmmmmmmmm 
m^mmmmmnsiE^WLmimmmmMVizmm - ^ 
m ^ mmnm^mNimmm^m^zmmim ^ ^ '^m 
mmm vop mmmmmzmmim^)'mm.'^ t^xm^i i m 
^ p s vop EiSii^^;t«f^it^ • 

ffi^JKBMV0P2:l?g'^#Jr*^®[I^Sla^^*4l3!£il 

nzmm(.m^»>^)mmmn ^o? mmmmmz\^mim 
#)ffiEm^j5tiiii: B^ VOP mmm^zn^^m - ^mm 
nmnn "lo"- mmn b-vop ^^sipb^ssii^f^ 
im ^ ^ ^ ^ m^mm.^zi^^mmmMmi^ 

\op m mm zmm (im^)mm.'^)ikmALim VOP mm. 
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mzmmmmmmwin vop mmmm^zmm(m^)m 

m PCT/JP 9 7/ 0 2 3 1 9 Sg^Si^i^ . Kffi|^]6^Jit|gm:^# 

nmm^mm^n^Tt^'tEy -m i-vop ga^&igsi^ . 

mmm mmm.mm'&LmmmmE.mmzn^mmmz 
Win '\"mxm^7tm ' ^.^^^mmmmn^ "^"i^x^ 

mmm 54.jtt^ i-vop^ffi^ntF^n^s^gp^Miiii- 

m Wi n { m is\ 29.97Hz z mm % 2997) m. ^ 

VOP_time_increment ;i » *f S • «S VOP ^ ^ ii * «| 

-7 E.M-^w.mmnzmi^mmnmmm{tL7tznmm 
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Mm ' mta ' 2997 ^.mi^nBmm 12 UTi - 

mmstmm^ p-vop -mmmmmmm^mm 
m-mmmitm^ ^2^mm^mmmmmnmitm i-yop 

mmM^^msummmmm^^zm ' Kmmmmmmmm 
mmmmm^ 54 • st^ i-vop zmmmmmzni^m^ 
f^.mttmm^ b-vop zT-mmmmmmm^^mm 

m^m^ 53 mmmnmnmmmmE,mmzmmmmm 

mm^mmmmmwm=-m^ b-vop z^m^i^^m^ 
m ' m.mmmmmmm. vop mmmmnsm^ 54 • jtt^ 
\-yo? ztiimmmmzn^m^H'mmm - 

mm^mmmmmwm^^^^T -mm. vop zmp^ 
ti^r-m I -VOP asfiM-ffi VOP wmmmm^mmm^ 
55mi^'fzmmm^mmmm.^z vo? mu^mm • 

m 7 BlM^]^^t!t^S ^ VOP^F^tiM^^Jgffi VOP 
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mmmmm i-vop^s B-voPHfr-itf^w p-vop^^si;^: 

mmmmmmmmm ^2 ' stmmmmmmmmmm ' mm 

ffimmmi^'f Yo? mmm&mm mm mi§ 64 m ^ Go\ 
mm^z^Ttmi^zmmmmmummm. vop ^^j^m 

mm ^ 63'^^ VOP ^F^iiM^iiiSI 63 M ^ ^ 
VOP_time_increment mM^l^l^a^SiSI^JJi 
VOP_time_increment_resolution rfff rT 2fe B Hif VOP 

m'^mmmmr^mm ' ^mmi^mm es^i i-vop zmm 
mmmmm - mM mmmmmmmmmmm^immmmm 
mm^^ ' Bmw. vop mmmmmmmmz vop \^mm 
mmm^immm^mmm^m nLmn i-vop z^nm 

I- vo? zM.mmm 

= time_code + modulo_time_base 
+VOP_tinie_increment/VOP_tiiiie_increment_resolution 

mnummmmmmm^iMmm^ GQ'ttmmmum 
mmm - 

m p-vopMa ' mmm^mmmmmm^ ^2 
m ' stmmmmmmmmmm ' mmmzmmmmmmffj 
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^m^mmm "r-mmmmz "i-mm^^^f - m vop 
m mm mm ^ mmm ^ GOV mmnz&ji^mzm 

mmmmfS eS^SJI^ VOP_time_ increment mS^mZWcS 
BMR^^iifs VOP_time_increment_resolution ifn rT @ HU 

m VOP 31 ^ tfn e«r It ^ ti a • mmmsYm^ es ^ b-vop 

mmmmm^m - ^ ^ « ya? mmmmmisim^z vop it 
mmmmmmm^mmmmm^ms^xmn p-vop zKm.m 

^ • BP : 

p-vop zM.^mm 

= time_co(ie+ modulo_time_base 

+ YOP_time_incremeni:/VOP_time_increinent_resolution 
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